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2016-2017 Impact Report: Six Years of Results From the Carnegie Math Pathways 
Abstract 


Traditional developmental mathematics sequences are a major impediment for community college 
students who need to acquire college-level mathematics credit in order to attain their long-term 
academic goals. Each year, approximately 500,000 students fail to complete their developmental 
mathematics coursework,’ jeopardizing their ability to earn an associate degree or technical 
certification, and/or transfer to a four-year institution for further education. In response to this 
national crisis, the Carnegie Foundation for the Advancement of Teaching founded the Carnegie Math 
Pathways. The Pathways include Statway® and Quantway®, two alternative courses that accelerate 
students’ progress to and through college-level mathematics. Since launching in 2011, the Pathways 
have served over 27,000 students and consistently demonstrated significantly higher success rates 
than the traditional course sequence. In 2016-2017, Pathways success rates increased further, even as 
the program served nearly five times as many students as in its first year. 


This report provides descriptive statistics for 2016-2017 student outcomes as well as insights into 
potential areas for improvement, based on data from the Pathways’ sixth year of implementation. 


The Problem 


Each year, more than 1.7 million first-time students” enter the community college system. Based 
primarily upon performance on a placement test, approximately 60% of these students are placed into 
one, if not more, developmental mathematics course(s). Fully 80% of them do not complete any 
college-level mathematics courses within as many as three years (Bailey, Jeong, & Cho, 2010). Many 
students instead spend years languishing in developmental mathematics sequences by repeating 
previously failed courses. Without a college-level math credit, they may drop out of college altogether 
without earning a degree or certificate. Developmental mathematics is a gatekeeper barring students 
from pursuing their academic and professional aspirations. 


The Pathways Solution 


In light of this national crisis, the Carnegie Foundation for the Advancement of Teaching established a 
network of college faculty, administrators, researchers, and program designers that co-created a 
transformative approach to developmental mathematics education: the Carnegie Math Pathways 
(formerly known as the Community College Pathways or CCP). The Pathways Networked Improvement 
Community (NIC) unites people in applying their individual expertise to achieve a common aim through 
disciplined inquiry and iterative testing of changes addressing a shared working theory of improvement 
(Bryk, Gomez, Grunow, & LeMahieu, 2015). Today, the Carnegie Math Pathways program is operated 
by WestEd, a national nonprofit education research and services organization. 


: Bailey, Jeong, and Cho (2010) claim that approximately 60% of first-time community college students are placed into 
developmental math courses. Of those students, up to 80% do not complete their credit-bearing math course within three 
years. According to data retrieved on March 13, 2017, from the National Center for Education Statistics-IPEDS Data Center, 
the average number of first-time community college students from 2011 to 2015 was approximately 1,100,000 annually. 
60% of that figure is 660,000, and 80% of this new amount is 528,000. Thus, approximately half a million students each year 
do not obtain college math credit. 

* See Snyder and Dillow (2011), Table 241. 
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Currently, the Pathways offer two alternative developmental mathematics programs, Statway® and 
Quantway® (see Figure 1). Statway is a year-long, college-level statistics sequence designed with 
supports for developmental math students. It integrates developmental and college-level content so 
students who complete the entire pathway fulfill both their remedial and college-level mathematics 
requirements, earning a college-level math credit. Quantway is a two-term quantitative reasoning 
pathway comprised of a developmental math course, Quantway 1, and a college-level course, 
Quantway 2. In both of its courses, Quantway embraces a substantive focus on quantitative reasoning. 
Statway and Quantway enable developmental math students to earn college-level mathematics credit 
in a single year, instead of the two or more years required with the traditional algebra-based sequence 
of courses. Further, the Pathways engage students in the statistical and quantitative reasoning 
concepts increasingly seen as more relevant to many students’ educational and career goals than those 
in the traditional algebraic sequence. 


STATWAY® QUANTWAY® 


Statway integrates developmental Quantway 1 is a single-semester 


mathematics skills and college- quantitative reasoning course that 


Se cake : fulfills the requirements for students’ 
level statistics into a collaborative, q 
developmental mathematics 
problem-focused class. 
sequence and prepares them for 


It replaces the traditional algebra ; 
success in subsequent college-level 


sequence with a year-long 
statistics sequence, allowing 
developmental math students to 
earn college-level credit for 


statistics in a single academic year. 


Statway embraces productive 


persistence and supports for 


math. 

Quantway 2 is a college credit-bearing 
quantitative reasoning course that can 
be taken subsequent to Quantway 1 
or as a standalone course. 

Quantway 1 and 2 embrace 
productive persistence and supports 


quality teaching in its theory of for quality teaching in its theory of 
PIOVTRER improvement. 


Figure 1. Statway® and Quantway® Descriptions 


Importantly, the Pathways initiative operates as a networked improvement community (NIC) using an 
improvement science framework. Improvement science uses evidence from rapid tests of change ideas 
to guide the development, revision, and iterative calibration of tools, processes, roles, and 
relationships to accelerate how a field learns to improve and address problems of practice. The 
innovative approach of the Pathways is represented by a driver diagram (see Figure 2), which serves as 
a shared working theory guiding the improvement work of its network members. The left-hand side of 
the driver diagram outlines the aim of the Pathways: to change developmental math from a 
gatekeeper to a gateway for students. The right-hand side of the driver diagram lists the seven primary 
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drivers, which are components of the Pathways that are essential to the initiative’s ability to reach its 
3 


aim. 


Accelerated, restructured pathway 


Ambitious, relevant, 
problem-centered curriculum 


Student-focused, collaborative 
pedagogy 


Change 
developmental 
math from 
gatekeeper to 
gateway 


Productive persistence 
interventions/practices 


Language and literacy supports 


Comprehensive and sustained 
professional learning opportunities 


Network engagement and 
improvement 


Figure 2. Pathways Driver Diagram 


Pathways Enrollment 

Statway and Quantway have achieved steady enrollment growth since launching in 2011-2012, and 
continue to spread to new campuses, scale at extant institutions, and serve more students with each 
passing year. The average increase in enrollment per year is 64%. In 2016-2017, total enrollment was 
7,522 (see Table 1)—nearly five times that of the first year of enrollment—with 415 sections taught by 
224 faculty members across 48 institutions (see Appendix, Table A1). 


Strikingly, Pathways success rates have remained consistently high in spite of the initiative’s ongoing 
expansion. Over the course of six years, the program has maintained high success rates while serving 
increasingly larger student populations (Hoang, Huang, Sulcer, & Yesilyurt, 2017; Huang, Hoang, 
Yesilyurt, & Thorn, 2016; Sowers & Yamada, 2015; Strother, Van Campen, & Grunow, 2013; Van 
Campen, Sowers, & Strother, 2013). 


> For more information on the Pathways system, please visit http://carnegiemathpathways.org. 
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Figure 3. Pathways Enrollment Over Six Years 


Table 1. Pathways Enrollment, 2011-2017 


| 201-12 | 2012-13 | 2013-14 | 2014-15 | 2015-16 _| 2016-17 | 
[institutions | 21 [22 | ze S| | 


|Quantway | Students | 418 | 1,402 | 1,843 | 2327 | 2,966 | 3,696 _| 
(institutions | 8 | a | | a3 |e | 
Total | Students | 1551 | 2,955 | 4,126 | 5,189 | 6,220 | 7,522 | 
mL sttutions[ 25 [30 [33 | 38” | 36 | as 


* Data reported in this table (and subsequent tables and figures) may vary slightly from statistics reported in previous impact reports. This 
difference exists because data have been updated to reflect new and more accurate information from participating colleges. In addition, 
data used to compute success rates for 2016-2017 and after are reported directly by faculty, whereas data for the previous years are 
from institutional research data. 

> Starting in Year 4, the total number of unique Pathways institutions does not equal the sum of the total number of unique Statway 
institutions plus the total number of unique Quantway institutions, because some institutions offered both Statway and Quantway. 


2016-2017 Impact Report: Six Years of Results From the Carnegie Math Pathways 


Statway Student Performance 

Statway’s success rate is defined as the percentage of students who started the course in the fall 
academic term and completed the full, year-long sequence with a grade of C or higher (the outcome 
required on most campuses for college credit to be awarded).° Overall, there were a total of 2,891’ 
students enrolled in the Fall 2016 cohort, and 1,780 (62%) successfully completed Statway. Table 2a 
shows Statway student success across all participating institutions—community colleges and four-year 
universities—over six years of implementation. 


Table 2a. Statway Student Success at Community Colleges and Four-Year Institutions 


Analytic Sample Completing the Full Pathway 
FallaiCohort | 18 | to | ST | OH 
Falla2Cohort | 22, | osm, |B | HO 


Fall 13 Cohort 1435 


The Fall 2016 cohort included 2,816 community college students, of whom 1,725 (61%) completed the 
full sequence with a grade of C or higher and earned college credit (see Table 2b). On average across all 
six years, approximately 52% of community college students successfully completed Statway. 


Table 2b. Statway Student Success at eommunity, Colleges 


| __[ stators | nat Somple | completing te Fullatmay | SU Rate 
a amp Completing the Full Pathway 

_Fallaicohort | 18 | 968 | | 8H 

Fa 2 Cohort [a8 [58 [as | 


Fall 13 Cohort 1,294 


Sita grading system is used that employs +/-, success in a course is defined as achieving a C- or higher. For the purpose of calculating the 
success rates, the denominator of the ratio includes those who received W (Withdraw) or | (Incomplete) grades, thus generating a more 
conservative estimate of success. 

"The analytic sample is based on students who begin the Statway sequence in the fall academic term. This allows us to compare one 
academic year to another based upon comparable conditions. Accelerated (one-term) Statway students were included in the analytic 
sample, regardless of their starting term. Total enrollment figures include students starting in any academic term within a given year. The 
sample was frozen on September 22, 2017. Thus, outcomes from any courses concluded afterward were not part of this analysis. 

® One college offered three-term Statway that began in winter 2016; thus, this academic year includes success numbers in summer 2016 
for that particular college. 
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Though it was intended to serve community college students, Statway has been employed successfully 
at a number of four-year universities. In the last six years, Statway has been offered at five California 
State University (CSU) campuses, where success rates have been higher than the NIC average. In 2016- 
2017, Statway was taught at one CSU campus where 55 of 75 students completed the full sequence, 
resulting in a 73% success rate (see Table 2c). Because students at community colleges tend to differ 
from those at traditional colleges in some important ways,” these results suggest that Statway can be 
beneficial in a variety of contexts. 


Table 2c. Statway Student Success at California State Universities 


aot Students Successfull 
Institutions Analytic . u Success Rate 
Completing the Full Pathway 


Fall 11 Cohort 


All Fall Cohorts 


533 


Across both community colleges and four-year institutions, Statway results are a dramatic 
improvement over traditional developmental mathematics outcomes. Only 6% of students placed into 
developmental mathematics earn college-level mathematics credit in one year through the traditional 
sequence.’ Only 15% of students placed into developmental mathematics successfully earn college 
mathematics credit in two years through the traditional sequence (see Figure 4). In contrast, across all 
six years of implementation, Statway students are achieving a 54% success rate—more than triple the 
success in half the time. 


* For example, CSU campuses have higher admission requirements than community colleges, which must admit all students. CSU 
students are also required to complete all developmental requirements in the first year. 

To compute this baseline success rate, we worked with institutional researchers from 18 Statway colleges in 2011-2012 to collect data 
on developmental mathematics course-taking prior to Statway implementation. Analyses revealed that only 5.9% of non-Statway 
developmental math students enrolled at these colleges in 2008 received credit for college-level mathematics in one year. Additionally, 
only 15.1% had achieved this goal after two years, 20.4% after three years, and 23.5% after four years. 
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Figure 4. Traditional Programs Versus Statway: Student Success (All Fall Cohorts) 


Quantway Student Performance 

For Quantway 1, student success is defined as the percent of unique students who enrolled in either 
the fall or spring terms and completed the course with a C or higher, or a pass in a pass/fail grading 
system’'—thereby fulfilling their developmental math requirements. In 2016-2017, the course 
achieved the highest success rate in its six years of implementation: 2,310 students (72%) out of 3,227 
enrolled successfully completed Quantway 1 (see Table 3a). Among those who successfully completed 
Quantway 1, 2,463 took the course in community college (with a success rate of 68%) and 764 enrolled 
in the course at four-year institutions (with a success rate of 84%) (see Table 3b). 


Table 3a. Student Success in Completing Developmental Math with Quantway 1 at Community 
Colleges and Four-Year Institutions 


iaceeutions Size of Students Successfully Suieonse Rate 
ae same a — 1 
2011-2012} 8 | 418 | 56% 


Student success in Quantway 1 far exceeds that of students in traditional developmental math 
sequences. Only 21% of a baseline group of developmental math students passed a traditional 


“Ifa grading system is used that employs +/-, success in a course is defined as achieving a C- or higher. For the purpose of calculating the 
success rates, the denominator of the ratio includes those who received W (withdraw) or | (incomplete) grades, thus generating a more 
conservative estimate of success. 
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developmental math course within one academic term” (see Figure 5). Quantway 1 students, on the 
other hand, with a 63% weighted average success rate across six years, achieve triple the success of 
the typical approach in a single semester. 


Table 3b. Student Success in Completing Developmental Math with Quantway 1 at Community 
Colleges versus Four-Year Institutions” 


ae Size of Students Successfully 
Institutions . . Success Rate 
Analytic Sample | Completing Quantway 1 
2015-201 i 
ees eae ey 13 1,813 1,079 60% 
Colleges 


Four-year 3 867 645 74% 
Institutions 
2016-2017 | Community 19 2,463 1,669 68% 
Colleges 
Four-year 
ie . 7 4 41 be 
jinsosons | [7 | tee 
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Quantway 1 
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63% 
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50% - | 


29% 
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Percent of Students Who Complete 
Developmental Math 


0% + 


1Term 2 Terms 1Term 


Figure 5. Student Success in Traditional Programs versus Quantway 1 


Quantway 2, the college-level companion course to Quantway 1, also yielded promising results in its 
fifth year of implementation. Of the 814 students enrolled in Quantway 2 in 2016-2017, 624 (77%) 


aaa) compute this baseline success rate under the traditional approach, we worked with institutional researchers from six of the first 
Quantway colleges. Analyses revealed that only 20.6% of students were able to successfully complete their developmental math 
sequence within a full year. Additionally, 28.5% achieved this goal after two years, 31.6% after three years, and 33.3% after four years. 
Table 3b only includes figures across two years, because 2015-2016 was the first year during which four-year institutions started 
implementing Quantway 1. 
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successfully completed the course with a grade of C or better and earned college credit’* (see Table 
4a). This, combined with the prior years of Quantway 2 implementation, results in an overall success 
rate of 71%. 


Table 4a. Student Success in Completing Transfer-level Math with Quantway 2 at Community 
Colleges and Four-Year Institutions 


iacerenOns Size of Students Successfully Greece nate 
Analytic Sample Completing Quantway 2 


The success rate at community colleges (72%) is impressive albeit lower than the four-year institution 
success rate of 81% (see Table 4b). However, the latter success rate may be influenced by institutional 
effects due to the small number of institutions in the analytic sample. The community college and four- 
year institution outcomes, taken together, suggest that Quantway 2 is an effective college-level 
mathematics option and that, similar to Statway, Quantway 2 is applicable to multiple contexts. 
Quantway 2 can be offered as a stand-alone college-level Quantitative Reasoning course or as part of a 
coherent Quantway pathway that combines Quantway 1 and 2. 


Table 4b. Student Success in FOmpeHng Transfer-level Math with Quantway 2 at Community 
— versus Four-Year Institutions” 


inekeuniGns Analytic Students Successfully suisesee Rate 
Sample Completing Quantway 2 
a Community 68% 
Colleges 


Pour veut 1 32 71 66% 
Institutions 
2016-2017 | Community 5 406 292 72% 
Colleges 
Four-Year 3 A408 332 81% 
Institutions : 


“Ifa +/- grading system is used, success in a course is defined as achieving a C- or higher. For the purpose of calculating the success 
rates, the denominator of the ratio includes those who received W (Withdraw) or | (Incomplete) grades, thus generating a more 
conservative estimate of success. 

* Table 4b only includes figures across two years, because 2015-2016 was the first year during which four-year institutions started 
implementing Quantway 2. 


2016-2017 Impact Report: Six Years of Results From the Carnegie Math Pathways 


Examples of Success in the NIC 

A number of institutions have implemented an accelerated version of Statway, one that compresses 
the entire pathway into a single term. This adaptation, referred to as “accelerated Statway,” removes 
the transition and potential exit point between Statway 1 and Statway 2 in the standard Statway 
offering.’° Although accelerated Statway was offered at only six colleges in 2016-2017, it accounts for 
over half of the analytic sample in Table 2a. Its outcomes were substantially higher than those of 
traditional two-term Statway, which in turn raised the overall Statway success rate. Among the 1,456 
students who took accelerated 


100% - 


75% + 70% (n = 1456) 


53% (n = 1435) 


50% 


25% ~ 


Percent of Developmental Math Students 
Who Earn College Credit 


0% + 


Standard Statway (2-term) Accelerated Statway (1-term) 


Figure 6. Statway Success by Mode of Implementation in 2016-2017 


Statway, 1,014 (70%) successfully completed the program. In contrast, 766 (53%) of the 1,435 students 
who enrolled in traditional Statway successfully completed the sequence (see Figure 6). With 
accelerated Statway generating continued interest and success, Pathways team members have 
interviewed faculty from institutions offering the adaptation to illuminate reasons for adoption, as well 
as perceived benefits and challenges to implementation (Huang, Norman, & Yamada, 2018). As the 
Pathways program continues to expand to new colleges, it is critical to investigate which types of 
adaptations are effective in different institutional contexts. 


Additionally, previous impact reports discussed a Statway college that deviated from core design 
features, such as a) keeping cohorts of students together between the first and second parts of the 
sequence and b) supporting professional development for Statway faculty. As a result, this institution’s 
success rates were well below that of the rest of the network as a whole. Because this institution 
enrolled a large number of students in Statway, it substantially lowered the overall network average 
success rate (Hoang et. al, 2017; Huang et. al, 2016). In 2016-2017, however, this institution’s success 
rate increased by over 10%. This institution also experienced a decrease in its withdrawal rate during 
the first term of Statway: the percentage of students who withdrew from Statway 1 was nearly 16% in 


© See subsequent section, “Improvement Priorities for Pathways Success,” in which a Pareto analysis identifies students 
who succeed in Statway 1 but do not enroll in Statway 2 as a major reason for failure to complete the Statway sequence. 


10 


2016-2017 Impact Report: Six Years of Results From the Carnegie Math Pathways 


2015-2016, but decreased to approximately 7% in 2016-2017. Between 2015-2016 and 2016-2017, 
this college made substantial adjustments to a few of its practices. First, it changed student eligibility 
for the course, limiting its Statway student population to non-STEM students for the 2016-2017 
academic year. Further, several instructors from this particular college took an optional Pathways 
Online Preparation (POP) course, which comprises seven modules lasting up to eight hours, during or 
immediately prior to the 2016-2017 academic year. There is not a clear relationship between these 
changes and student outcomes. However, the factors contributing to this institution’s increased 
success rates merit further investigation. The Pathways team plans to leverage improvement science 
methods to learn from this success story, and identify key tools and processes from this college that 
may be helpful to share with the rest of the network. 


Improvement Priorities for Pathways Success 

Now, in the sixth year of Pathways implementation, the essential question is how the Pathways may be 
improved to further increase student success. The NIC is using improvement research tools to explore 
the ways in which students fail to succeed in order to identify potential new drivers and better target 
interventions. Of the two Pathways, Statway is more complex, in large part because it maintains a 
cohort of students across two semesters. Consequently, it provides more opportunities for the 
examination and identification of areas for improvement. In the analyses below, we examine each 
point at which students who were enrolled in the standard two-term Statway sequence in 2016-2017 
failed to complete one part of the pathway or continue into the next. 


In 2016-2017, 766 students in standard Statway (47% of those enrolled)’ (see Figure 6) were 
unsuccessful in completing the course. Chronologically, there are five primary ways that a student 
could have failed to succeed: 

¢ Withdrew from the first term of Statway (SW1), and thus did not enroll in the second 

term of Statway (SW2) 

* Completed but failed SW1, and thus did not enroll in SW2 

e Succeeded in SW1, but did not enroll in SW2 

e Succeeded in SW1, enrolled in SW2, but withdrew from SW2 

e Succeeded in SW1, enrolled in SW2, but failed SW2 


A very common tool in improvement work is the Pareto chart. The chart is based on the Pareto 
principle, which states that 80% of any problem stems from 20% of the factors that lead to the 
problem. A Pareto chart is often used to represent those factors—in this case, categories of failure— 
sorted from most to least common. The chart typically also has a line showing the cumulative 
percentage of failures attributed to each of the failure categories. In Table 5 and Figure 7, one can see 
how common each form of failure is and what contribution it makes to the overall error rate. 


"The analytic sample for the Pareto analysis includes only standard Statway students for whom a transition from the first to the second 
course of the sequence was relevant. Students taking the one-term accelerated Statway adaptation were excluded. 
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Table 5. Categories of Student Failure to Complete the Standard Statway Sequence in 2016-17 


. Percent of Non- 
Pareto Categories Number of Students 
Successful Students 


1. Succeeded in SW1, Did Not Enroll in SW2 
2. Failed in SW1 


4. Withdrew in SW1 
5. Withdrew in SW2 


The Pareto chart (adapted from Provost & Murray, 2011) in Figure 7 shows each of these forms of non- 
success. Light blue bars depict the number of students falling into each category of non-success in the 

2016-2017 academic year, and the dark blue line shows the cumulative percentage of students (across 
the five forms of failure) who did not succeed in the sequence. This analysis helps reveal high-leverage 


points that are ripe for improvement by researchers, faculty, and college administrators. 
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Figure 7. Non-Success in Statway in 2016-2017 


First, it is clear that the first and second categories account for the largest percentages of students who 


fail to complete the standard Statway sequence. We believe both of these failure-to-succeed 
conditions can be addressed by aspects of our first primary driver: “Accelerated, restructured 
pathways.” Since the first category describes students who were academically successful in the first 
term but did not subsequently enroll in the second term, it is important to understand why they 
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unexpectedly failed to continue the sequence. Does this stem from students’ lack of understanding of 
Statway’s structure as a sequence? Are students simply unable to enroll in the second term due to 
scheduling difficulties? If this is primarily an administrative problem, can processes be developed to 
improve advising and encourage (or even mandate) enrollment of successful students in the following 
term? There are positive examples from colleges that have used automatic placement of students who 
have been successful in the first term to the second term, which can nearly eliminate this failure 
condition. There are also negative examples in which colleges do not offer the second-semester course 
at the same time and days as the first term, which can create significant obstacles for students who are 
working and have little or no flexibility in their schedules. The Pathways team has included evaluation 
of the sources of failure and possible responses in the implementation supports for institutions. 


Complex questions also arise with regard to the second category, which includes students who failed 
Statway 1. For instance, are there particular characteristics of these students or their contexts that are 
unique? Can we compare what is being done in classrooms with high and low success rates to 
understand if there are differences in implementing the primary features of Statway (e.g., active, 
collaborative learning and socio-emotional supports)? If the intervention works in some classrooms or 
institutions and not others, can the nature in which these contexts differ be captured to better prepare 
instructors or improve the materials? The Pathways team is currently testing one response that targets 
one known pattern of Statway 1 (and Quantway 1) failure—students who are placed in the courses and 
struggle with some aspects of arithmetic. Several colleges have been working on a set of lessons that 
address the “big ideas” of arithmetic that would be provided as an additional support in the first weeks 
of the course. Colleges are testing various forms of delivery (e.g., meeting 30 minutes before each 
course session, dedicated tutoring in separate sections, etc.). The Pathways team will be reviewing the 
results from prototype testing in winter 2018 and will be making the lessons available for broad use in 
fall 2018. 


Failure in Statway 2 represents the third-largest category of non-success. While many of the questions 
surrounding category two apply to this category as well, another point of interest may be to investigate 
the differences and similarities between students who fail in the first term of Statway and those who 
fail in the second term of Statway. 


Because the percentage of students in the fourth and fifth categories (withdrawing from Statway 1 and 
withdrawing from Statway 2) are relatively small, these modes of failure may be a lower priority for 
investigation than the others, at least in the immediate term. As with category one, these data suggest 
the need to examine the effectiveness of advising and placement for Statway 1 as well as the design 
and implementation of both Statway 1 and 2. For example, are students dropping the course because 
they are not receiving enough or the right kind of support? What criteria are being used by advisors to 
refer students to a Pathways program? It is possible that course failure rates and withdrawals are being 
driven by inappropriate placement decisions. 


Using an improvement approach suggests investigating the practical theory that informed the creation 
of Statway to determine if that theory needs to be refined to improve the program beyond that which 
has been realized to date. With this analysis, the Pathways network is well prepared to examine 
specific aspects of the program and identify priorities for improvement. The Pathways team has great 
confidence around these efforts. Prior improvement work (e.g., single-term Statway acceleration) has 
eliminated a source of failure for schools that have implemented it: students exiting the sequence 
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between the first and second courses of the standard two-term Statway sequence. Classroom 
interventions to improve attendance and homework completion that were developed, tested, and 
refined in the NIC are improving course-level success rates. The deliberate application of disciplined 
improvement techniques continues to improve the overall success of the program. 


Conclusion 


In the 2016-2017 academic year, the Carnegie Math Pathways program continues to outperform 
traditional developmental math courses by a wide margin. With institutional changes in one of its 
largest colleges as well as wider adoption of an accelerated delivery format, Statway success rates have 
substantially increased in comparison to previous years. A central aspect of this year’s improvement 
work will focus on learning from colleges that have implemented accelerated Statway, among other 
types of adaptations, to glean insights into how the Pathways can continue to evolve to fit increasingly 
diverse student and institutional needs. Quantway experienced a similarly dramatic increase in success 
rates due to the scaling of the program at four-year colleges/universities. Accordingly, another 
potential direction for research is to illuminate how—aside from different student demographics—the 
Quantway experience at four-year colleges may differ from that at two-year community colleges. The 
ultimate goal of these investigations is to discern actionable insights to spread to the rest of the 
Pathways NIC for continuous improvement. 


Overall, Statway and Quantway 1 continue to deliver three to four times the success rate of traditional 
pathways in half the time. Strikingly, the Pathways managed to uphold these results while expanding 
its reach to an increasingly diverse range of contexts, suggesting that improvement science has 
ensured the initiative’s effectiveness, even as it spreads and scales. Overall, year six results reinforce 
the existing evidence that the Pathways can help large numbers of students across an array of contexts 
acquire mathematics knowledge in pursuit of their academic and career goals. 
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Participating Institutions in the 2016-2017 Academic Year 


STATWAY 

American River College 

Chippewa Valley Technical College 

College of Marin 

De Anza College 

Diablo Valley College 

Foothill College 

Kapi'olani Community College 

LaGuardia Community College 

Los Angeles Pierce College 

Minneapolis Community and Technical College 
Minnesota State College - Southeast Technical 
Mission College 

Mt. San Antonio College 

Normandale Community College 

Renton Technical College 

Richland College 

Rochester Community and Technical College 
San Diego City College 

San Jose State University 

Seattle Central Community College 

South Seattle Community College 
Southwestern College 

Tacoma Community College 

Tallahassee Community College 


QUANTWAY 

Capital Community College 
Chippewa Valley Technical College 
Cuyahoga Community College 
Fashion Institute of Technology 
Kent State University 

Laramie County Community College 
Madison College 

Mohawk Valley Community College 
Morrisville State College 

Niagara County Community College 
Nicolet Area Technical College 
Onondaga Community College 
Ridgewater College 

Rockland Community College 


Schenectady County Community College 


Sinclair Community College 

South Georgia State College 
Suffolk County Community College 
SUNY Adirondack 

SUNY Broome Community College 


Tompkins Cortland Community College 
University of North Georgia, Gainesville 


University of Washington, Bothell 
University of Wisconsin-Milwaukee 
Westchester Community College 
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Appendix 


Table A1. Pathways Enrollment, 2016-2017 


rot [as | ae | 7s 


The Pathways student body is diverse and includes groups that have been historically underserved in 
higher education. Both Pathways enroll more females than males and large percentages of minority 
students. The average age of students is higher than that of a typical entering college student. 


Table A2. 2016-2017 Pathways Student Demographics’” 


SSCS 
3 


8 


*8 The total number of unique Pathways faculty does not equal the sum of the total number of unique Statway faculty and the total 


number of unique Quantway faculty, because one instructor taught both Statway and Quantway. 

2 Demographic data in previous impact reports were provided by institutional researchers at participating colleges. Starting in 2015- 
2016, these data were self-reported by students on a survey distributed at the beginning of the course. Over 30% of students did not 
complete demographic items on the survey, indicating the need to explore new ways of increasing the response rate to more accurately 
understand the Pathways student body. 
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Table A3. Statway Enrollment and Success, Fall 2011 to Fall 2016 


Fall 
2011 
Cohort 


Fall 
2012 
Cohort 


Fall 
2013 
Cohort 


Fall 
2014 
Cohort 


Fall 
2015 
Cohort 


Fall 
2016 
Cohort 


CCs* 


CSUs 


Combined 


CCs 


CSUs 


Combined 


CCs 


CSUs 


Combined 


CCs 


CSUs 


Combined 


CCs 


CSUs 


Combined 


CCs 


CSUs 


Combined 


Colleges 


18 
2 
20 
18 
4 
22 
19 
3 
22 
16 
2 
18 
20 
1 
21 
21 
1 


22 


swl 
Enroll 


968 
152 
1,120 
853 
204 
1,057 
1,294 
141 
1,435 
1,391 
94 
1,485 
2,467 
64 
2,531 
2,816 
75 


2,891 


SsW1 
Complete 


890 
151 
1,041 
774 
199 
973 
1,115 
140 
1,255 
1,206 
93 
1,299 
2,196 
61 
2,257 
2,655 
75 


2,730 


sw1 
Success 


649 
130 
779 
603 
180 
783 
887 
131 
1,018 
922 
81 
1,003 
1,656 
57 
1,713 
2098 
66 


2,164 


sw2 
Enroll 


563 
121 
684 
524 
170 
694 
788 
122 
910 
815 
74 
889 
1,394 
55 
1,449 
1,863 
58 


1,921 


SW2 
Complete 


523 
119 
642 
501 
167 
668 
716 
122 
838 
730 
74 
804 
1,335 
54 
1,389 
1,819 
58 


1,877 


sw2 
Success 


468 
99 
567 
445 
153 
598 
620 
117 
737 
652 
68 
720 
1,212 
51 
1,263 
1,725 
55 


1,780 


swl 
Enroll 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


100% 


SW1 
Complete 


92% 
99% 
93% 
91% 
98% 
92% 
86% 
99% 
87% 
87% 
99% 
87% 
89% 
95% 
89% 
94% 
100% 


94% 


sw1 
Success 


67% 


86% 


70% 


71% 


88% 


74% 


69% 


93% 


71% 


66% 


86% 


68% 


67% 


89% 


68% 


75% 


88% 


75% 


sw2 
Enroll 


58% 


80% 


61% 


61% 


83% 


66% 


61% 


87% 


63% 


59% 


79% 


60% 


57% 


86% 


57% 


66% 


77% 


66% 


SW2 
Complete 


54% 
78% 
57% 
59% 
82% 
63% 
55% 
87% 
58% 
52% 
79% 
54% 
54% 
84% 
55% 
65% 
77% 


65% 


sw2 


Success 


48% 
65% 
51% 
52% 
75% 
57% 
48% 
83% 
51% 
47% 
72% 
48% 
49% 
80% 
50% 
61% 
73% 


62% 
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Table A3 (continued). Statway Enrollment and Success, Fall 2011 to Fall 2016 


Colleges swi swi swi sw2 sw2 sw2 
Enroll Complete Success Enroll Complete Success 

CCs 34 9,789 8,836 6,815 5,947 5,122 5,122 

Total CSUs 5 730 719 645 600 594 543 
Combined 39 10,519 9,555 7,460 6,547 6,218 5,665 


swil 
Enroll 


100% 


100% 


100% 


SW1 
Complete 


90% 
98% 


91% 


sw1 
Success 


70% 


88% 


71% 


sw2 
Enroll 


61% 


82% 


62% 


SW2 
Complete 


57% 
81% 


59% 


sw2 
Success 


52% 


74% 


54% 
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Table A4. Quantway 1 Enrollment and Success, Spring 2012 to Spring 2017 
Colleges Enroll Complete Success Enroll Complete Success 


2011-2012«#dSsti(<tsti«iBC(<i‘éC GtCiB8Ss100%)—838%—(i«~C HS 
2012-2013 8 1,402 1,180 732 100% 84% 52% 
2013-2014 49 11-2Ss«1,805. 1,536 = 1,062 «100% += 85% 59% 
2014-2015 10 1,936 1,516 1,107 100% 78% 57% 
2015-2016 16 2,680 2,360 1,724 100% 88% 64% 
2016-2017 23S s«3,227' Ss 3,083. ~S2,310 «100% + «=: 96% 72% 
Total 16 11,468 10,021 7,169 100% 87% 63% 


Table A5. Quantway 2 Enrollment and Success, Spring 2013 to Spring 2017 
Colleges Enroll Complete Success’ Enroll Complete Success 


2012-2018«=C«8t (it (ts s—<“<i=‘éz;C0%SSCiC«iCHSC“‘«t‘«i CS 
2013-2014 3 217 187 145 100% 86% 67% 
2014-2015 3 168 132 96 100% 79% 57% 
2015-2016 5 286 256 193 100% 90% 67% 
2016-2017 7 814 800 624 100% 98% 77% 


Total 5 671 575 434 100% 86% 65% 
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